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Abstract. The dimension datum of a closed subgroup of a compact Lie group is a se- 
quence by assigning the invariant dimension of each irreducible representation restricting 
to the subgroup. We prove that any sequence of dimension data contains a converging 
sequence with limit the dimension datum of a subgroup interrelated to subgroups giving 
this sequence. This rigidity has an immediate corollary that the space of dimension data 
of closed subgroups in a given compact Lie group is sequentially compact. Moreover, we 
deduce some known finiteness and rigidity results from it, as well as give an application 
to isospectral geometry. 



1. Introduction 

Given a compact Lie group G, let G be the set of equivalence classes of irreducible 
finite-dimensional complex linear representations of G. We endow the space iF with the 
product topology of the discrete topologies on the factors Z. Given a closed subgroup H 
of G, the function 

@ H : G ^ Z,V ^ dimV H 

is an element of Z G , where V H is the linear space of H- invariant vectors in a complex 
linear representation V of G. We call S^h the dimension datum of H . In this way we have 
a map 

S 1 : {closed subgroup of G}/(G — conjugacy) — > Z G , H H> S>h- 

Dimension data arise from number theory in the determination of monodromy groups 
(cf. [K]). They also appear in differential geometry: in relation with the spectra of the 
Laplace operators on Riemannian homogeneous spaces (cf. [Sut] ) . Moreover, Langlands 
has suggested to use the dimension data as a key ingredient in his program "Beyond 
Endoscopy" (cf. |Laj . Page 2, Problem (II)). In the literature, dimension data have been 
studied in the articles |LP| . [Lar| and |AYY| . 

Endowing the space Z G (identified with the set of all maps from G to Z) with the 
product topology of the discrete topologies on the factors Z, we could consider the con- 
vergence of sequences of dimension data. Since < dmiV H < diml/ for any complex 
irreducible representation V of G and any closed subgroup H of G, each sequence of di- 
mension data {£$Hi '■ i > 1} contains a convergent subsequence as elements in Z G . This 
raises a question: is the limit still a dimension datum Qln and does {Hi : i > 1} give some 
restriction on HI Theorem 11.11 answers this question completely. It states that the limit 
must be a dimension datum S>h and the subgroup H is strongly controlled by a subse- 
quence {Hi. : j > 1}. We also give some consequences of Theorem II. II bv strengthening 
a theorem of Larsen and give different proofs of two theorems proving in a joint paper 
[AYYj . as well as giving an application to isospectral geometry. 

Theorem 1.1. Given a compact Lie group G, let {H n \ n > 1} be a sequence of closed 
subgroups ofG. Then there exist two closed subgroups H,H' of G with [Hq,H' q ] C H C H' 
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and H' quasi-primitive, a subsequence {H nj \ j > 1} and a sequence {gj\ j > l,gj € G}, 
such that 

VjTlldKH'ojcgjH^gJ 1 cH 

and 

lim @ Hn . = @ H - 

This theorem has an immediate corollary. 
Corollary 1.2. The subset Im(^) C lP is a closed subset oflP. 

Corollary 11.21 can be equivalently stated as follows. 
Corollary 1.3. The topological space Im(f^) is sequentially compact. 

Here the topology on Im(£F) means the subspace topology inherited from the topology 
on iP. 

Theorem 1 1.1 1 is equivalent to the combination of the following two theorems. Theorem 
11.41 is a statement about dimension data, and Theorem 11.51 is an extension of Theorem 12.21 
to non- finite closed subgroups. 

Theorem 1.4. Given a compact Lie group G, let {H n \ n > 1} be a sequence of closed 
subgroups of G. Then there exists a closed subgroup H of G, a subsequence {H n . \ j > 1} 
and a sequence {gj\ j > l,gj G G}, such that 

Vj > 1, [Hq, Hq] C gjH^gJ 1 C H 

and 

lim @ Hn . = 9h. 

Theorem 1.5. Given a compact Lie group G and a closed subgroup H, there exist a 
quasi-primitive subgroup H' of G such that [Hq,H' q ] C H C H' . 

Notation and conventions. Given a compact Lie group G, 

(1) let Go be the connected component of G containing the identity element and [G, G] 
the commutator subgroup. 

(2) Write G^ for the set of conjugacy classes in G. 

(3) Denote by [iq the unique Haar measure on G with J G lfic = 1. 

(4) Write G for the set of equivalence classes of irreducible finite-dimensional complex 
linear representations of G. 

(5) Denote by V G the subspace of G-invariant vectors in a complex linear represen- 
tation V of G. 

Acknowledgements. The author thanks Jiu-Kang Yu, Jinpeng An, Brent Doran and 
Lars Kiihne for useful discussions and helpful suggestions. The influence of Michael 
Larsen's work in jLarj on this article is also obvious to the reader. 

2. Primitive and quasi-primitive subgroups 

In [Yu| . we define primitive and quasi-primitive subgroups and prove a generalization 
of a theorem of Borel and Serre by using them. In this section, we recall the definition 
and some results in that paper. Lemma 12.31 Proposition 12.41 and Lemma 12.51 are used in 
the proof of the main theorem of this paper. Lemma 12.51 is due to A. Weil (cf. []). 
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Definition 2.1. A closed subgroup H of a compact Lie group G is called Lie primitive if 
(^4g)o C H and for any closed subgroup K of G containing H with K$ normalizing Hq, 
either [G : K] is finite or [K : H] is finite. It is called Lie quasi-primitive if there exists 
a sequence of closed subgroups of G, G = Hq d H\ D ... D H s = H, such that each Hi + \ 
is Lie primitive in Hi, < i < s — 1. 

Theorem 2.2. Given a finite subgroup S of a compact Lie group G, there exists a Lie 
quasi-primitive subgroup H of G containing S and satisfying that: 

(1) Hq is a Cartan subgroup of G, or 

(2) Hq is not abelian and SAh/Ah is a Lie primitive subgroup of H/Ah- 

Lemma 2.3. Given a compact semisimple Lie group G and a non-primitive closed sub- 
group S, there exists a primitive subgroup H of G containing S and such that dim H < 
dim G, and Sq is a proper normal subgroup of Hq . 

Proposition 2.4. Given a compact Lie group G, there exist only finitely many conjugacy 
classes of Lie primitive and Lie quasi-primitive subgroups of G. 

Lemma 2.5. Given a finite group S and a compact semisimple Lie group G, the number 
of conjugacy classes of homomorphisms from S to G is finite. 

3. Proof of the main theorem 

An element in Z G can be expressed as a sequence n = {a p \ p € G}, or equivalently as 
a function n : G — > Z, 

n{p) = a p ,Vp G G. 

i > 1} converges to n if and only if for any 

= n(pj) 

for each j, 1 < j < m. 

Let Xq = {ft £ Z^| < n(p) < dim/^Vp G G}. Then 9 H G X G for each closed 
subgroup H of G. Since Xq is a closed compact subset, we have the following proposition. 

Proposition 3.1. Any sequence {H n \ n > 1} of closed subgroups of G contains a subse- 
quence {H n A j > 1} such that 3>H n . converges to some element n in Xq. 

Proof of Theorem We prove it by induction on dim G. 
Step 1. Reduction to the case that [Go, Go] C H n for any n. 

Let go be the Lie algebra of G and Uo = [floiflo] the derived subalgebra of go- Then uo 
is a compact semisimple Lie algebra. There is an adjoint homomorphism 

7r : G — > Aut(uo). 

Write G' = Aut(uo). It is a compact semisimple Lie group of adjoint type. 

Assume first there are infinitely many n such that dim7r(il n ) ^ dimG', by replacing 
{H n \i > 1} by a subsequence if necessary, we may assume that dim7r(il n ) < dimG' 
for any n > 1. By Lemma l2.3( each ir(H n ) is contained in a primitive subgroup of G' 
with a lower dimension. As primitive subgroups of G' have only finitely many conjugacy 
classes (cf. Proposition 12. 4p . we may assume that all n(H n ) are contained in a primitive 
subgroup Gi of G' with dimGi < dimG'. Write G2 = tt~ 1 (Gi). Since 7r(H n ) C Gi, we 
have H n C G2 for any n. We finish the proof in this case by induction. 



In the topological space Z G , a sequence {n^ 
finite subset {pj\ 1 < j < m} of G, we have 

lim Hi(pj) 

i— <rco 
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Now assume there are only finitely many n such that dimir(H n ) ^ dimG', by replacing 
{H n \ n > 1} by a subsequence if necessary, we may assume that dimir(H n ) = dimG' for 
any n > 1. For any n, from dimir(H n ) = dimG" we get 

dimlnt(uo) = dimG' = dim7r(i? n ) = dimir(H n n Go). 

Thus ir(H n n Go) = Int(uo) since Tt(H n n Go) C Int(uo) and Int(uo) is connected. 

We have Go = Zq [Go,Gq], Gq/Zg — Int(uo) and tt : Gq — > Int(uo) is just the 
projection map Go — > Gq/Zg q - For any n, since n(H n n Go) = Int(uo), we have (H n n 
G )Z Go = G . Thus 

[Go, Go] = [(H n n Zg )Zg , H n n Zg )Zg ] = [H n n Za ,H n n Zg ] c H n . 

From now on, we assume that [Go, Go] C H n for any n. 
Step 2. Reduction to the case that Gq is abelian. 

Given a p € G, if p\\g ,g ] does not contain any non-zero trivial subrepresentation, we 
have 

9 Hn {p) =dimVf» = 0. 
If p\[g ,g ] contains a non-zero trivial subrepresentation, p is a subrepresentation of 

Ind &o > Go]( 1 [Go,G ])- 

Here 1[g ,g ] is the 1-dimensional trivial representation of [Go, Go]. The action of [Go, Go] 
on p is trivial because [Go, Go] is a normal subgroup of G. Hence p factors through the 
homomorphism G — > G /[Gq,Gq\. We only need to consider dimension data of the 
subgroups {H n /[Go,Go] \ n > 1} of G/[Go,Go]. As (G/[Go,Go])o is abelian, we reduce it 
to the case that Go is abelian. 

From now on, we assume that Go is abelian. 

Step 3. Reduction to the case that {-£f n nGo| n > 1} are all equal to some Z' C Go and 
Z' is a normal subgroup of G. 

Set N n = H n /(H n n G G (G )). Then N n C G/G G (G ). Since G/G G (G ) is a finite 
group, there are only finitely many possibilities for N n . We may assume that they are all 
equal to some iV C G/Cg{Gq). The finite group ./V acts on Go by conjugation. 

Consider the sequence {H n n Go| n > 1}. The sequence of dimension data associated 
to it contains a convergent subsequence by Proposition 13.11 We may assume that the 
sequence of dimension data itself converges. Denote by L be the dual group of Go, i.e. 
the set of isomorphism classes of 1-dimensional complex linear representations of Go- Then 
L is a lattice. Write L'cL for the subset of irreducible representations p of Go such that 

lim dimp HnnGo = 1. 

n—>oo 

Claim 3.2. L' is an N-stable sublattice. 

We defer the proof of Claim [3721 and finish the proof of Theorem 11.11 first . Let Z' C Go 
be the intersection of the kernels of the linear characters in L' . By Claim [3721 L' is Te- 
stable. Thus Z 1 is also iV-stable. Choose a basis {pj\l < j < m} of L'. For any j, there 
exists an kj such that dim p^" nG ° = 1 for any n > kj. Write 

k = m&x{kj : 1 < j < to}. 

For any n > k and any j with 1 < j < m, we have dimp^" nGo = 1. That is to say, 
H n n Go acts trivially on pj. As pj is a basis of L', we have H n n Go acts trivially on any 
p E L'. This means 

H n nG c z' 
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for any n > k. Replacing {H„ n Go C Z'\ n > 1} by a subsequence if necessary, we may 
assume that H n C\ Gq G Z' for any n > 1. Since Z' is iV-stable and N n = N, we have 
-f/n C Ng(Z'). Replacing G by Nq(Z'), we may and do assume that Z' is normal in G. 
Let HL =H„Z'. 



n 



Given a a E G, if o~\g does not contain any simple irreducible sub-representation 
isomorphic to an element of L' , then 

lim dim p Hn = lim dim p Hn = 0. 

If o"|g contains a simple irreducible subrepresentation isomorphic to an element of L', 
the action of Z' on a must be trivial. Thus 

lim dim p Hn = lim dim p^™^ = lim dim p Hn . 

n— >oo ' n— >oo ' n— >oo 

By the above, 

lim ^h-, = lim 9 H 

n— >oo n— >oo 

Replacing {-ff n | > 1} by {H' n \n > 1}, it reduces to the case {H n n Go| n > 1} are all 
equal to some Z' C Go and Z' is a normal subgroup of G. 

From now on, we assume that Go is abelian, there is a subgroup Z' of Go that is a 
normal subgroup of G, and H n F\Gq = Z' for any n > 1. 

Step 4- Conclusion. 

Arguing similarly as in Step 2, for any p G G, if does not contain any non-zero 
trivial subrepresentation, then @H n (p) = dimVp n = for any n > 1. If contains 
a non-zero trivial subrepresentation, the action of on p is trivial. Hence p factors 
through the homomorphism G — > G/Z' . We only need to consider the dimension data 
of the subgroups {H n /Z'} of G/Z'. 

Now each H n /Z' is a finite group with order bounded by |G/Go|. By Proposition 12.51 
there is a subsequence {H nj \ j > 1} of {H n \ n > 1} such that the subgroups in {H nj } 
are conjugate to each other. Let H be one of {H nj } and H' = G. Then they satisfy 
the desired conclusion of the theorem. Going through the reduction steps, we see that 
the subgroup H' so constructed is a quasi-primitive subgroup of the original compact Lie 
group G. □ 

Proof of Claim HOI Given a p € L', there exists a k p > 1 such that dimV^™^ = 1 for 
any n > k p . As Go is abelian, we have dimp = 1. The above equality means that H n DGo 
acts trivially on p for any n > k p . For another p' € L' , there also exists a Ay > 1 such 
that H n n Go acts trivially on p' for any n > k p >. Set k = max{k p , k p >}. Then H n n Go 
acts trivially on p ±a <8> /o /=l=1 for any n > k. Here p -1 is the contragredient representation 
of p. Hence we have p^ 1 <S> p'^ 1 G L'. Therefore, L' is a sublattice of L. 

For any n > 1, since A^ n = H/(H n Gc ) = iV, we get that is stable under the 
conjugation action of iV. Hence the set of those p G L such that dimV^ nnG ° = 1 is also 
stable under N. Therefore, L' is stable under N. □ 

Theorem li.il implies Corollary By Theorem ll.il there exists a closed subgroup -ff of 
G and a subsequence {H n \ j > 1} such that 



Hence 



lim @ Hn . = ® H . 

J—tOQ J 



n = lim 3> Hn = lim 3#H n , = 



□ 
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4. Some consequences 
Now we fix a compact Lie group G. 

In |Lar| . given a finite-dimensional complex linear representation V of G, Larsen studied 
the moments 

dim(V m ® (V*)® b ) G 

and got some rigidity properties for them. Without loss of generality we may assume 
that V is a unitary representation of G, it is clear that the moments encode a part of 
the information of the dimension datum of the subgroup G of U(V). Theorem 14,21 is 
an analoguous statement of Theorem 4.2 in |Lar| . It is clear that Theorem 14.21 implies 
Theorem 4.2 in [Lar . We also use Theorem 11.11 to prove some theorems in a joint paper 
[AYYJ. The proofs here are different and independent with those in |Larj and |AYY| . 
Moreover, we give an application of Theorem 11.41 to isospectral geometry. 

Definition 4.1. A compact Lie group H is called a quasi-torus if Hq is a torus. 

In the case that {H n \ n > 1} in Theorem 1 1 . 2 1 are all quasi-tori, we can say more about 
the closed subgroup H. Theorem 14.21 below strengthens [Lar], Theorem 4.2 by making 
the convergence valid for dimension data rather than only for moments. 

Theorem 4.2. IfnE iP is the limit of a sequence of dimension data of quasi-tori of G, 
then n = 3>h for some quasi-torus H contained in G. 

Proof. Denote by 

ft = lim @H n ■ 

n— >oo 

By Theorem II .1\ there exist two closed subgroups H, H' C G with [H' , H' ] C H C H', 
a subsequence {H n .\ j > 1} and a sequence {gj\ j > l,gj € G} such that 

Vj>l,[H' ,H' ] CgjH^gJ 1 c H 

and 

lim @ Hn . = 9 H . 

j— >oo J 

As each H n . is a quasi-torus and [Hq,H' ] C gjHn.gJ 1 , we have [Hq,Hq] = 0. In other 
words, Hq is a torus. Therefore Hq is a torus since H C H'. We also have 

n = lim @ H = lim $ Hn , = $ H . 

□ 

Lemma 4.3. Given two closed subgroups H and H' of G, if H C H' and 3>h = 
then H = H' . 

Proof. Suppose H C H' is a proper inclusion. All i/'-invariant functions in the space 
Ind|^ 1h = L 2 (H'/H) are constant functions, so there exists a non-trivial irreducible 
representation a of H' appearing in Indj^ 1#. Choosing any irreducible representation p 
of G appearing in Ind^/ a, then a C p\w ■ Thus 

dimp H - dimp H ' > dimcr H - dimcr^' > 1 - > 0. 

Hence @ H i=- @H'- ^ 

Theorem 4.4. Given an element ft € TP , there are only finitely many conjugacy classes 
of closed subgroups H of G satisfying $>h = ft. 
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Proof. We prove it by contradiction. Suppose there are infinitely many conjugacy classes 
of closed subgroups H such that Sfjj = ft. Then there exists a sequence of pairwise 
non-conjugate closed subgroups {H n \ n > 1} of G such that &>H n = n for each n > 1. 

By Theorem II .1\ there exists a closed subgroup H of G, a subsequence {-£f nj | j > 1} 
and a sequence j > l,<?j € G} such that 



and 



Vj > 1. //, //,. // ; 1 C H 



lim 5^ n . = ®h- 



As subgroups in the sequence {H n .\ j > 1} are non-conjugate to each other, we have a 
proper inclusion gj H njo gJ^ C H for jo = 1 or 2. Moreover, we have 

®H = hm Hn . = ft = 9 ' „ -i. 

Write H" = gj Q H njo gj\ Then H" C H is a proper inclusion and = S>h- This is in 
contradiction with Lemma 14.31 □ 



Theorem 4.5. Given a closed subgroup K ofG, put n = S>k and {K\, . . . , K r } = <2l 1 (n). 
Then n is an isolated point in Im(£F) if and only if K\, . . . , K r are all semisimple groups. 

Proof. We omit the proof for the "only if" part of the statement. There is a nice and 
short proof of this in [AYYj . 

For the "if" part, suppose n = @k is not an isolated point in Im(£F). Then there exists 
a sequence {H n \ n > 1} of closed subgroups of G such that S>H n ^ n for any n > 1 and 

lim S>h„ = n. 

n— ¥oo 

By Theorem 1 there exist two closed subgroups H, H' C G with [H' , H' ] C H C H', a 
subsequence {H n .\ j > 1} and a sequence {gj\ j > l,gj £ G} such that 

Vjyi^H'^H'ojCgjH^gr 1 C H 

and 

lim 3> Hn . = 9 H . 

From these we get [H' Q ,H' Q ] C H C H' Q and ft = @ H - Thus H G ^ _1 (n). As ^ _1 (n) 
consist of semisimple subgroups, we get that H is semisimple. Together with [H' ,H' ] C 
Hq C Hq, we get [i^Q,^] = Hq. Hence Hq C gjH nj g~ x C il for any j > 1. Therefore 
there exists an infinite set such that gj v H nj ^gJ^ are equal to each other. We may and 
do assume that {H nj \ j > 1} are equal to each other. Write H" for one of them. Then 
3>H" = By Lemma 14.31 we get H" = H. This is in contradiction with the fact that 
3>H n 7^ ft for any n > 1. □ 

Given a closed Riemannian manifold (X, m) , one can define the Laplacian operator on 
the linear space of L 2 -functions on X. It is a self-adjoint positive definite linear operator, 
so its spectrum consists of discrete real numbers, which is called the Laplacian Spectrum 
of (X, m) . Given a compact connected Lie group G with a biinvariant Riemannian metric 
m, for each closed subgroup H of G the homegeneous space G/H inherits a Riemannian 
metric, still denoted m. We are interested on the Laplacian spectra of these homogeneous 
spaces here. 

Proposition 4.6. Given a a compact connected Lie group G with a biinvariant Riemann- 
ian metric m, there exist finitely many conjugacy classes of closed subgroups H of G with 
the Laplacian spectra of (G/H, m) equal to a given one. 
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Proof. We prove it by contradiction. Given a Laplacian spectrum, suppose there are 
infinitely many conjugacy classes of closed subgroups H such that the spectra of (G/H, m) 
equal to a given one. Then there exists a sequence of pairwise non-conjugate closed 
subgroups {H n \ n > 1} of G such that the Laplacian spectra of (G/H,m) being equal 
to each other. By Theorem 11.11 there exists a closed subgroup H of G, a subsequence 
{H nj | j > 1} and a sequence {gj\ j > l,gj G G} such that 

Vj > l, gj H nj gj l C H 

and 

lim 9 Hn . = ® H . 

j—toc J 

As subgroups in the sequence {H n , \ j > 1} are non-conjugate to each other, we have a 
proper inclusion g jo H n . Q gj^ C H for j = 1 or 2. Write H" = g jo H nn gj^. Since the 
Laplacian spectrum of (G/H,m) can be caculated from the dimension datum of H, the 
Laplacian spectrum of (G/H,m) is equal to that of H" . Hence, H" C H is a proper 
inclusion and (G/H,m) and (G/H" ,m) have the same Laplacian spectrum. This is in 
contradiction with Lemma 14.31 □ 
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